Annealed and Mean- Field formulations of Disease Dynamics on Static and Adaptive Networks 
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We use the annealed formulation of complex networks to study the dynamical behavior of disease spreading 
on both static and adaptive networked systems. This unifying approach relies on the annealed adjacency matrix, 
representing one network ensemble, and allows to solve the dynamical evolution of the whole network ensemble 
all at once. Our results accurately reproduce those obtained by extensive numerical simulations showing a 
large improvement with respect to the usual heterogeneous mean-field formulation. Moreover, by means of 
the annealed formulation we derive a new heterogeneous mean-field formulation that correctly reproduces the 
epidemic dynamics. 
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A variety of natural and socioeconomic complex systems 
have a networked interaction backbone. This interaction back- 
bone is usually described as a graph where nodes represent the 
constituents of the system and edges account for the relation 
between them. The complex network's approach has proved 
to be a powerful tool to unveil common topological proper- 
ties of systems related to seeming ly different fields HI]. The 
ubiquity of properties such as the small-world phenomenon 
and the scale-free character of real interaction networks, has 
spurred on applied and theoretical research aimed at under- 
standing the origin of their underlying principles. 

In the last decade the studied on how structuralproperties 
of complex networks affect their functionality (2, \M have fo- 
cused the attention of the physics of complex systems. Most 
of the theoretical studies about the dynamics on top of com- 
plex networks make use of synthetic networks with some pre- 
scribed structural properties in order to study the impact that 
these topological features have on the dynamical behavior. 
Typically, the dynamics is carried on top of a number of dif- 
ferent networks that can be seen as microstates of a large net- 
work ensemble characterized by some topological properties 
of interest. The numerical simulation of the dynamics on top 
of a large enough number of network realizations belonging 
to the same topological ensemble allows to obtain meaning- 
ful averages for the dynamical quantities that characterize the 
state of the system. However, the computational costs increase 
with the complexity of both the network ensemble and the dy- 
namics at work. Apart from numerical simulations, dynam- 
ical processes on static networks have been widely studied 
by means of the heterogeneous mean-field (HMF) approxima- 
tion 0-Sl- This formulation relies on the dynamical equiva- 
lence of the nodes belonging to the same degree class, i.e. the 
set of nodes with the same number of neighbors. The HMF 
coarse-graining has provided important insights about the crit- 
ical phenomena taking place on several dynamical processes 
and, although it has been recently debated in the context 
of contact processes 1P7I— TTotl . it has constituted the main the- 
oretical framework for the study of dynamical processes on 
complex networks. 



In this Letter we study the Susceptible-Infected-Susceptible 
(SIS) epidemic dynamics by means of the annealed adjacency 
matrix (AAM) of an entire network ensemble. We show how, 
inserting the AAM into the microscopic equations for the dy- 
namics of the nodes, it is possible to overcome the need of 
statistics over network realizations and to obtain accurate re- 
sults about the dynamical state of the system. On the other 
hand, we show that the HMF formulation fails to reproduce 
the SIS diagram, even for the case of uncorrelated networks. 
Moreover, we will use the annealed formulation to derive a 
new HMF formulation that, for the first time, captures the en- 
tire epidemic phase diagram. Finally, we show how the an- 
nealed formalism can be efficiently applied to the important 
case of adaptive networks in which network growth coevolves 
with SIS dynamics, thus providing with an unifying frame- 
work for the study of general epidemic dynamics in complex 
systems. 

The idea behind the annealed approximation is to deal di- 
rectly with the network ensemble of interest rather than with 
a collection of network realizations (see | IT - 3l for its appli- 
cation to the study of both structural and dynamical properties 
of networks). A ensemble is a family of networks, each of 
them represented by an adjacency matrix, A, with binary en- 
tries: Aij = 1 when nodes i and j are connected and Ay = 
otherwise. All the networks belonging to the same ensemble 
share some topological quantities, being the most general the 
ensemble of graphs with fixed number of nodes, N, and links, 
L. Other ensembles recently explored IU2I1 are those com- 
posed of networks with the same degree distribution P(k), i.e. 
the probability of having a node with k connections. One net- 
work ensemble can be described by a single matrix, the AAM, 
whose terms, Aij, account for the probability that two nodes 
share a connection as dictated by the ensemble constraints. 
To construct the AAM of a given network ensemble, one can 
average over the set of adjacency matrices or to define each 
element Aij from scratch by calculating the probability of at- 
taching i to j. In the following we will focus on ensembles of 
undirected networks, Aij = Aji . 

To show the use of the annealed approximation for the study 
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of dynamical processes on top of static networks we will ana- 
lyze the spreading of a SIS disease. The SIS disease spreading 
takes place as usual: Starting from a fraction I of infected 
nodes, at each time step the infected nodes attempt to infect 
each of their neighbors with a success probability A. Addi- 
tionally, infected nodes recover (and become susceptible of 
being infected in the next time steps) with probability p. Typ- 
ically, after enough time steps the number of infected indi- 
viduals reach a steady number that characterizes the impact of 
the disease. The infection probability A plays a key role on the 
disease spreading. In particular, when the ratio A//i exceeds 
some critical value (X/p) c the disease infects a macroscopic 
part of the population whereas below this epidemic threshold 
the time evolution of the number of infected nodes vanishes. 
Therefore, A/ p acts as a control parameter of the phase transi- 
tion from the healthy to the epidemic phase while the asymp- 
totic fraction of infected nodes, /, is the order parameter. 

The SIS phase diagram of a network ensemble described by 
a given AAM can be accurately obtained by using a Markov 
chain formulation similar to that introduced in IU7I1 for par- 
ticular network realizations. In our case, we denote as Si(t) 
the probability of finding node i in the healthy state (s, = 1) 
after t time steps in a randomly chosen network of the ensem- 
ble. We can express the evolution for the set of probabilities 
{si(t)} through the following set of discrete-time Markovian 
equations: 

Si (t + 1) = 8i(t) +n[l- Si(t)] - Si (t) [1 - q. t (t)} , (1) 

where qi (t) is the probability that node i is not infected by any 
neighbor: 
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The last two terms of the right-hand side of equation ([TJ cor- 
respond to the recovery of infected nodes and the infection 
of healthy nodes respectively. Note, that the above time evo- 
lution has the same functional form of the equations intro- 
duced in lfl7ll but, instead of having a particular adjacency 
matrix Ay, we have the probability that two nodes, i and j, 
are connected in a randomly chosen network of the ensemble, 
i.e. Aij. By iterating equations (HJ from the initial condition 
Si = 1 — Iq Vi, a stationary distribution {s°°} is reached and 
the order parameter / for the corresponding network ensemble 
is computed as / = ^(1 — sf D )/N. 

The most general network ensemble is provided by the 
configurational model iflill that generate a family of graphs 
by specifying a fixed degree sequence for the N nodes, 
{k\, &2, k^}. Each particular network realization is con- 
structed by sorting each of the L available links (L = 
hi/2). The probability that two nodes i and j are chosen 
to be connected in one network realization depends on their 
respective degrees as kikj / (2L 2 ). Therefore, the probability 
that, after sorting the L links, two given nodes i and j with 
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FIG. 1: The top and bottom left panels show the phase diagrams, 
/(A), for the numerical simulations (points), the annealed formalism 
(squares), the usual (dashed line) and the new (solid line) HMF ap- 
proximation. The networks have been constructed using the configu- 
rational model as introduced in fl9ll with degree sequences following 
power-law degree distributions, P(k) ~ k 1 , with 7 = 2.2, 2.6 and 
3.0. The networks have N = 5000 and (k) = 4 and the statistics 
of the numerical simulations is made over 500 network realizations 
for each value of A. Besides, the bottom right panel show the frac- 
tion of infected nodes of degree k, p(k), using numerical simulations 
(points) and the annealed formalism for the case 7 = 2.2 and several 
values of A. The recovery probability is set to p = 0.3. 



Now, inserting this latter AAM in eqs. Q] and [2] we can study 
the SIS dynamics of configurational ensembles. In Fig. Q]we 
represent the curves and the fraction of infected individu- 
als with degree k, p(k) obtained via the annealed formulation 
and the use of extensive numerical simulations of the SIS dy- 
namics. The results of /(A) are shown for three families of 
configurational ensembles corresponding to P{k) ~ k 1 with 
7 = 2.2, 2.6 and 3.0. The network realizations used for the 
numerical simulations were constructed using the method in- 
troduced in [19] so to assure that no degree-degree correla- 
tions are present in any of the networks generated. As shown 
in Fig. Q] the results obtained using the AAM strongly agree 
with those obtained through extensive numerical simulations. 

We have compared the results of the AAM formulation 
with those obtained with the HMF. Surprisingly, the HMF 
fails to reproduce the phase diagrams /(A) as observed in 
Fig. Q] The reason of these discrepancies can be explained 
with the annealed formulation of the SIS dynamics. Tak- 
ing the continuous-time formulation and assuming that all the 
nodes with the same degree have the same probability of be- 
ing healthy, i.e. Sj = pk Vi with fcj = k, we can derive a new 
HMF approximation from eqs. (Q]i and the expression of Aif. 
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degrees fc, and kj are connected is Aij = Aij = kikj/(2L). where Nk = NP(k). This new HMF approximation when in- 
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tegrated for the different model networks perfectly reproduces 
the annealed approximation in contrast with the usual HMF 
approximation extensively used in network epidemiology up 
to date JUS. 

The natural extension of eqs. (01 and to general net- 
work models is done by considering that the probability of 
finding two nodes of degrees k and k in the configura- 
tional model, P(k ,k) = kk /2L, reads as P(k ,k) = 
kP(k \k) / [N P{k')) for general network models. Then, we 
can write the new HMF as: 



Pk = Pk)~Pk 



k L 



1 - A 



kP{k \k) 



k' 



(4) 

Note that the new HMF formulation takes the form of the 
usual HMF equations only when A(l — Pk) "C 1 Vfc: 

Pk ~ n (1 - p k ) - Xk Pk £ P(k'\k)(l -pg) + 0{\ 2 ) (5) 

k' 

Therefore, the usual HMF is only correct for A values before 
and around the epidemic onset (as observed from Fig. [U. 

Now we describe the case of ensembles of networks con- 
structed via attachment processes. In this case, network re- 
alizations are usually assembled by starting (at r = 0) from 
a small graph of mo nodes coupled all-to-all. Therefore, the 
A AM has Aij = 1 for i and j = 1, mo provided i ^ j 
and An = otherwise. At each step r of the network growth 
(t = 1,...,N— mo) a new node is added and launches I links to 
the nodes of the network. Each of these nodes have some at- 
tachment probability, (r) (i = l,...,r+mo — 1), of receiving 
one of the I links from the new node. Therefore, the remaining 
(N 2 - ml) terms of the AAM read Aij = 1 - (1 - U m (M )) 1 
(where m = min(i, j) and M = max(£, j)) when i ^ j, and 
An = otherwise. Once the AAM is constructed one can 
obtain the annealed degree of the nodes as fc, = J^j •Aij- 

The networks grown through attachment processes are 
know to have nontrivial node-to-node correlations (e.g. age 
correlations) that play a key role in their dynamical behavior 
and are difficult to capture via HMF formulations. Now we 
show that these peculiarities of the attachment ensembles are 
captured by the annealed formulation of the SIS dynamics. 
Let us focus on the preferential attachment kernel introduced 
by Barabasi and Albert (BA), IL; (r) = h (r) / Y,j k j 0~) 01 • 
In this case the networks have a power law degree distribution, 
P(k) ~ k~ 3 , and average degree (k) = 2m. Thus, by fixing 
the value of m we can construct an ensemble of BA networks 
with the same values of (k). In Fig. [2] we show the results 
of J(A) and p(k) by solving equations Q] with the expression 
of Aij corresponding to three BA ensembles with m = 2, 5 
and 10. Again, the results of the AAM approximation show a 
perfect agreement with those obtained by means of numerical 
simulations of the SIS dynamics on top of BA networks. 

Now we focus on a more complicated attachment kernel de- 
scribing a network growth interplaying with the internal dy- 
namics of the nodes. In particular, the two entangled pro- 
cesses (network growth and system's dynamics) coevolve in 
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FIG. 2: (Top) In the left we show the epidemic phase diagram I(X) 
for three BA ensembles with (k) = 4, 10 and 20. In the right we 
show the fraction of infected individuals across degree-classes p(k) 
for the ensemble with (k) = 4 and for different values of A. The 
points correspond to numerical simulations of the SIS dynamics on 
top of 500 network realizations while curves stand for the annealed 
approximation. The size of the networks is N — 5000. (Bottom) 
Again, we show both 7(A) (left) and p(k) (right) for the case of adap- 
tive growing networks when N = 10 4 . Both results of numerically 
grown networks (points), averaged over 5000 realizations, and the 
solutions of the annealed formalism (curves) are shown. The net- 
work development is characterized by fi — 0.3, tt = 1 and / = 3. 



such a way that the attachment preferences of newcomers are 
driven by the dynamical states of their predecessors. There- 
fore, the attachment probability of a node i at time t > i, 
Hi (t) depends, not only on the topological properties of node 
i, but also on its instant dynamical state Xi(t). In our case 
Xi(t) = Si(t) and the attachment kernel reads: Hi(t) = 
ki(t)si(t)/ J^j kj{t)sj(t). This particular kernel couples net- 
works growth and SIS dynamics so that newcomers prefer 
acquaintances with both structural importance and a healthy 
state. Therefore, infected nodes cannot receive a link from 
newcomers until they recover, whereas those healthy elements 
compete with each other according to their degrees as in the 
preferential attachment model. 

The study of the above adaptive growth mechanism can be 
efficiently tackled with the help of the annealed formulation. 
To this aim we consider again the Markov SIS equations (Q]i 
incorporating a time-dependent AAM, Ait), in equation (f2]i 
that evolves simultaneously to the disease spreading. The ini- 
tial condition of the AAM is set to Aij (0) = 1 for i, j < mo, 
j ^ j and Aij = otherwise, while the dynamical state of 
the nodes is initialized as: s;(0) = 1 — In when i < mo and 
s,(0) = 1 otherwise. Then, we couple equations (Q~|) with the 
evolution of the AAM: 



Aij{t) = H(t - t t M) [1 - (1 - n m (r T M))' 



(6) 



when i ^ j and An = otherwise. The function H(x) is 
the Heaviside step function so that the above equations state 
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FIG. 3: Accumulated degree distribution of growing adaptive net- 
works when N — 10 4 . The numerical results (points) and the distri- 
bution obtained from the evolution of the AAM (curves) are shown 
for several values of A. The networks are grown using tt = 1, / = 3 
and p = 0.3. Numerical results are obtained averaging over 100 
network realizations for each value of A. 



that the element Aij has a zero value until the youngest ele- 
ment M is incorporated. At this step, t = TtM, the value 
of jumps to a stationary value that only depends on the 
attachment probability of the oldest node m at time M. 

Iterating the above dynamics until the system size have 
reached a large enough value TV (so that it has reached a 
stationary regime for its intensive observables) we can eval- 
uate the asymptotic impact of the disease and the structural 
properties of the generated networks. First, in Fig. [2] we 
show the phase diagram /(A) and the microscopic distribu- 
tion of infected nodes across degree-classes, p(k). Both mea- 
sures clearly show the accuracy of the annealed approxima- 
tion when compared to the results obtained averaging over a 
number of numerically grown networks. Besides, in Fig. [3] 
we show the corresponding accumulated degree distributions 
of the grown networks using different infection probabilities 
A. From the figure we show that the AAM generated repro- 
duces correctly the degree distributions obtained numerically. 
In particular, it is shown that for small values of A rather ho- 
mogeneous networks are obtained, pointing out that the preva- 
lence of disease on network hubs, as shown in Fig. |2](bottom 
right panel), screens their fitness to attract new links and thus 
avoids the development of degree heterogeneity. On the con- 
trary, for large A the disease affects homogeneously the form- 
ing system and newcomers mainly guide their links towards 
large degree nodes, thus recovering the behavior of the BA 
preferential attachment model. 

Summing up, in this Letter we have shown that the dy- 
namical behavior of static and adaptive networks can be ef- 
ficiently described by the use of an unifying framework: the 
annealed formulation of the adjacency matrix. In both cases, 
the annealed formulation allows to compute the macroscopic 
observables and the microscopic distributions of the dynam- 
ics of a network ensemble in one single computation, thus 
avoiding the need of extensive simulations. In the case of 
adaptive networks, the treatment of the AAM as a dynamical 



object allows a simple formulation of the coupled structure- 
function problem. Particularizing to the case of SIS disease 
spreading on top of static networks, we have shown that the 
HMF approximation does not reproduces the phase diagram. 
Moreover, using the annealed formulation of the dynamics we 
have obtained a new HMF formulation that shows, for the first 
time, an accurate agreement with the numerical results. The 
use of the annealed formulation in other kind of network dy- 
namics only requires to substitute the usual adjacency matrix 
by the AAM in the microscopic equations at work. There- 
fore, the formalism allows to write down explicitly the evolu- 
tion equations for a wide variety of network ensembles, adap- 
tive schemes and dynamics, regardless of their stochastic (e.g. 
contact processes, information diffusion, evolutionary dynam- 
ics, etc) or deterministic (e.g. nonlinear dynamical systems) 
nature. Although more research is needed to assess to what 
extent this approach can be such an important improvement in 
other dynamic network models, we expect that the annealed 
formulation will allow to tackle several open problems on net- 
works dynamics and will pave the way to the theoretical stud- 
ies of the growing field of complex adaptive systems. 
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